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If the time evolution of an open quantum system approaches equihbrium in the time mean, then 
on any single trajectory of any of its unravelings the time averaged state approaches the same equi- 
librium state with probability 1. In the case of multiple equilibrium states the quantum trajectory 
converges in the mean to a random choice from these states. 

^: 

O ■ I- INTRODUCTION 

O; 

' Stochastic Schrodinger equations and their solutions, quantum trajectories, have been extensively studied in the last 
G . 15 years (cf. [Car], [GaZ]). They provide insight into the behaviour of open quantum systems and they are invaluable 
. ^ ■ for Monte Carlo simulations of the time evolution of such systems, in particular for the numerical determination of 
equilibrium states. 

In performing such simulations one is confronted with the problem, whether it is necessary to average over many 
trajectories, or if it suffices to calculate the time average over a single trajectory, which is often more convenient (cf. 

^ ' In this paper we prove that for any finite-dimensional quantum system and for any initial state the time average of 

C^ i; a single quantum trajectory converges to some equilibrium state with probability one. This result holds true despite 
T-H ■ the fact that the quantum trajectory itself may stay away from equilibrium forever. 

vN [ In the simple case that there exists only one equilibrium state, the above result implies that the path average 

converges to this particular state, almost surely and independently of the starting point chosen. So in one sense the 
quantum trajectory is ergodic in this case: The path average of any observable of the quantum system equals its 
f~^ . expectation in the equilibrium state. However, when looked upon as a classical stochastic process with values in the 
space of all quantum states, the quantum trajectory need not be ergodic, even in this simple and well-behaved case: 
There may be disjoint regions in the space of all quantum states between which no transitions are possible. 

In a previous paper [KiiM] we have considered the ergodic properties of the observed output of open quantum 

"^ , systems. We found that quantum systems with finite dimensional Hilbert spaces and unique equilibrium states lead 

jrt • to ergodic observations. Strangely enough, the techniques needed to prove our present result seem to be entirely 

^ different from the ones used in that paper. Here we make strong use of martingales, which have been introduced 

O^ to this context in [Bel]. As in [KiiM] we concentrate our discussion on jump processes in continuous time using the 

►^ formulation of Davies and Srivinas [Dav] [SrD] . But the result also holds for diffusive Schrodinger equations and for 

•I— I . quantum evolutions in discrete time, as they occur in repeated measurement situations like the micromaser [WBKM]. 

^^ ■ The paper is organizied as follows. We formulate our result in Section II and introduce the necessary martingales 

H ' in Section III. In Section IV the proof of the theorem is given. It is extended to the diffusive and discrete time cases 

■ - - in Sections V and VI, respectively. 

II. THE MAIN RESULT 

The state of an open quantum system is described by a density matrix p on a finite dimensional Hilbert space Ti, 
obeying a Master equation p = Lp, where L is a generator of Lindblad form [Lin] , 



o 
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L{p) = i[H, p]+J2 V^pV* - \{V*V,p ~ pV*V,) 
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Here 7f, Fi, . . . , V^ are linear operators on 7i, H being self-adjoint. 
Conservation of normalisation of p is expressed by the relation 



trL(/7) = foraUp. (2.1) 



An unraveling of p is induced by a decomposition of the generator 

k 



L = Ln + J2j^^ (2-2) 



i=l 

where Ji{p) — VipV* would be a natural choice. In general, any decomposition can be treated for which e*^", t > 0, 
and Ji, i ~ 1, . . . ,k, are completely positive. 

This decomposition may be interpreted as follows. The open system is under continuous observation by use of k 
detectors. The reaction of the detectors to the system consists of clicks at random times. The evolution p i-^ e^'"°{p) 
denotes the change of the state of the system under the condition that during a time interval of length t no clicks are 
recorded. The operator p >-^ Ji{p) on the state space describes the change of state conditioned on the occurrence of 
a click of detector i. 

So, if p describes the state of the system at time 0, and if, during the time interval [0,t], clicks are recorded at 
times ti, t2, • • • , in of detectors ii, ^2, . . . , in respectively, and none more, then, up to normalisation, the state at time 
t is given by 

Mituii), ■■■, (in, ^n)) = e(*-*")^o j^^g(t„-*„-i)io . . . e(*^-*i)^o J,^e*i^o(p) . (2.3) 

The probability density for these clicks to occur is equal to the trace of i3t in (2-3). We shall denote the normalized 
density matrix "dt/ti (i?t) by Ot. 

We imagine the experiment to continue indefinitely. The observation process will then produce an infinite detection 
record ((ii,zi), (t2,i2), {t3,h), ■ ■ ■) , where we assume that < ti < ^2 < is < • • • , and lim„_^oo in — oo (i.e., the 
clicks do not accumulate). Let il denote the space of all such detection records with Lebesgue-measure 

oc k k 



did — y^ y^ ■ ■ ■ /^ dti ■ ■ ■ dtn ■ 
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As was shown in [KiiM], each initial state i^o determines a probability measure P''" on Vt whose restriction to the 
time interval [0,i] has density tr('!9i) as described above. We may consider {Qt)t>n as a stochastic process on this 
probability space taking values in the density matrices. A path of this process is called a quantum trajectory. We 
thus obtain an unraveling of the state at time t > 0: 



So far the framework is essentially the same as described in our previous paper [KiiM] . It is the framework frequently 
used in computer simulations (cf., e.g., [Car], [GaZ]). If one is only interested in the average evolution e*^, then the 
decompositon 2.2 can be chosen at will. 

We now address the question, what can be said about the asymptotic behaviour of each single quantum trajectory 
(et(u;))t>o. 

Let us denote by £ the space of equlibrium states, i.e. density matrices p which are left invariant by the average 
evolution Tj. Since the Hilbert space is finite dimensional the limit 

1 /■* 

P(i?) = lim - / Ts{'d)ds (2.5) 

t^OC t Jq 

exists and projects any density matrix ?9 onto the space £ of equilibrium states. 

Theorem 1. Suppose that Tt — e*^ has only a single equilibrium state p. Then for every initial state {fo the quantum 
trajectory {Qt)t>o satisGcs 

1 '■' 



lim — / Og{uj)ds = p 

t^oo t J„ 

for almost all lo with respect to the probability measure P"*" . 



More generally, in the case that there is more than one equilibrium state, one has almost surely 



1 /•* 

t^oo t Jo 



where Qoo JS ^ random variable, depending on the initial state ^q, and taking values in the equilibrium states. The 
expectation ofQ^ is P(i?o)- 

The proof of this theorem is inspired by the arguments leading to Breiman's strong law of large numbers for 
Markov chains [Bre] (see also [Kre]), which however does not apply directly to the situation of continuous time 
quantum trajectories. Our proof, based on the martingale convergence theorem (Section III), will be given in Section 
IV. In our discussion we make free use of standard stochastic notation and arguments for which we refer, e.g., to 
[Doo], [vKa], [ChW]. 

III. MARTINGALES 

The process {Qt)t>o consists of smooth evolution according to e*^" interrupted by jumps of different types i = 1, . . . ,k, 
namely Ot h^ JiOt/^^ (Ji^t)- Let Ni{t) denote the number of jumps of type i before time t. In the theory of point 
processes [Ram], [vKa], [Bar] it is well known that, from the probability density (2.3), it follows that the unconditioned 
probability density of the occurrence of a jump of type i at time u, given the state Qs at time s is 

tr {Tt^uJ^Tu-s{Qs)) = tr ( J,r„„,(e,)) 

for i > M > s > 0, independent of i > m. Let Ef" denote expectation with respect to P''", given the process up to 
time s. 

In a similar way as (2.4) follows from (2.3), it is easy to show that r„_s(9s) — IEf''(0„), and therefore 

Ef« {Ni ~ Nl) - y tr {Tt^uJ^Tu-s{e)s)) du = Ef« (j tr {.h{Qu))du 
If we now denote by Nl the process 

Ni-.^Nl^ f tr J,{eu)du, 
Jo 

then Nl is a martingale, [Doo], i.e., for all < s < i: 

Et«iNi)^Nl. 
{Nl)t>Q is the compensated number process of jumps of type i. 
Lemma 2. The quantum trajectory {Qt)t>o satisfies the stochastic Schrodinger equation [Car], [BGM] 

^e.^L(e.).t + |:(^J^-e.)c^^;. (3.1) 

where the stochastic differential equation is interpreted in the sense of ltd [ChW]. 

Proof. Between jumps dt evolves according to -^-dt = Lo{-dt), at a jump of type i it jumps from i3t to Ji{i3t). It 
follows that the normalised state 8( = 'dt/tr{'0t) satisfies 



dt\t,({l,)J ^Vlr(A(9.)) 



Since between jumps we have 



dt ytri,,) J tri,.) tr(^.p - ^0(6.) - 6. • tr (Lo(e.)) 

and since dN}: = dNJ: + tr (Ji(<dt))dt, we have, using that tr o L = 0, 

dOt = (Lo(9t) - Ot ■ trLo(90)rft + J^ ( Ju^qa) ~ Q*) ' (^^^' + ^' W^t))dt 



-«e,M,.g^jj^|^-e.).*;^ 



The process Qt starts at Qq = i9q. Let us now consider two other stochastic processes 

M, :. e.-,,-J\mds^J^±[^^-e.))dNi (.>0), 

and 

From the fact that Nl is a martingale, it foUows that these processes are martingales as well [ChW] 
We now come to the main result of this section 



Proposition 3. For any intial state '&o the quantum trajectory {&t{^))t>a satisfies 

_____ r 

t^oo t 
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lim - / L{esiLo))ds^O 

:^00 t Jo 
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/o 
almost surely with respect to P''" . 

Proof. Let us first consider the martingale Yt which takes values in the self-adjoint matrices. In order to conclude 
from the martingale convergence theorem [Doo] that {Yt)t>n converges almost surely, we show that E''°(tr (F^^)) 
remains bounded: 

Denote the coefficient (-^^j^ - 6*] by XI Then 



dVt = ^ jXldNi . 

i=l 

By the Ito rules for jump processes [ChW] dNldNf — dN^dN^ — SijdN^, we find that 

From d{Yt^) = 2YtdYt + {dYt^ and E''«(diV;) = 0, hence E"^" (tr (YtdYt)) = 0, we obtain E''«(d(tr (F^^))) 
E''o(tr((dFt)2)). Therefore, since E'^^idNl) == E'^^itr J,{Qt))dt, 

dE'»''(tr(y,2)) =E'»«(tr((rfy,)')) = ^Ee"" (tr ((X,^)^) . tr (J,(eO)) di 

i=l 



hence 

In this sense, (yt)t>i is L^-bounded and it follows that Yt converges almost surely to some random variable Y. In 
particular, since Yt is continuous up to finitely many jumps on compact time intervals and has a limit as t ^ oo 
almost surely, it is bounded almost surely. Therefore, applying the partial integration formula, which is also valid if 
Yt has jumps, we obtain for i > 1 



Mt^Mi+ sdY,^ Ml + sYs 



t pt 

Ys ds^Mi+ tYt I Ysds 



therefore, 



1 1 1 /■* 

lim -Mt == lim -Mi + lim Yt - lim - / Ys ds 

t—*oo t i — *co t i — *co t — '■CO t /i 

= O + Y-Y 

^ . 



We thus conclude that 



£m ^fot-^o- f LiOs) ds\ =0 . 
As (6t — -do) remains bounded, the statement of the Proposition follows. D 

IV. PROOF OF THE MAIN RESULT 

We shall prove Theorem 1 in two steps. 

Step 1. If P is given as in 2.5, then for any initial state do the limit 

lim P{et) =: Ooo 

t — *oo 

exists almost surely with resprect to F"^" , and satisfies E''''(8oc) = P{i^o)- 

Proof. Acting with the operator P on both sides of (3.1) in Lemma 2 wc see that E''" (^P{dQt)) = 0, hence {P{'dt))t>o 
is a martingale. Since it takes values in the states it is bounded, and therefore it converges almost surely, say to the 
random variable Oqo- The expectation of Ooo is P{do), the initial value of the martingale (-P(6t))t>o- D 

Step 2. For any initial state do we have, almost surely with respect to P"*": 

1 /•* 
lim - {Qu- P(Qu)) du^O. (4.1) 

t^oo t Jo 



Proof. First we show that, for all s > 0, 



lim i / (e„-r,(e„))dM = o. (4.2) 

t^oo t Jo 



Indeed, since ^T^, — T^L 



t /'t /"S 

{Tg — id){Qu)du = TyL{Qu) dvdu 

Jo Jo 

tJJ L{Qu) du\ dv 



Dividing by t and taking the limit t -^ cxd, we obtain 4.2 by Proposition 3. 
Clearly, averaging 4.2 over [0, s] preserves its validity: 



Tv{Qu) dv \ du = 



lim If (Ou-- 

In the above we want to take the limit s ^ oo before the limit t -^ cxd, in order to obtain the statement 4.1 to be 
proved: 

This is allowed since TL is finite-dimensional: Then for e > there exists s > such that 11-!- (^^T^dv — P\\ < § , 

W s JO W 1 ' 

hence 



T,(e„H)(i«-p(e„H) 



e 
<2 



uniformly in u. For P "-almost every w G il we find to such that for t > to 

i / (qu{uj) --[ r„(e„(u>)) dv) du 

Then, we obtain for such t 



£ 

<2 



(e„H - p(e„H))du 



i I (e„(w) - P{Qu{oj)) +-[ T,{Qu{io))dv --( T,{Q^{uj))dv^ du 



< 







9„(w) / rt,(9„(w)) dv 1 du 



r„(e„H)d«-p(e„H) du 



£ £ 

< 2 + 2=^- 
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V. DIFFUSIVE QUANTUM TRAJECTORTIES 

The ergodic result obtained above is not confined to jump processes. Solutions of the Master equation p = Lp with 

fe 

L{p) = z[H, p] + Y, v,pv; - \{v*v,p - pv;v,) 

can alternatively be unraveled into a diffusion Qt on the state space, satisfying the stochastic differential equation 

[Bel], [Car], [BGM] 



dQt = L{Qt)dt + ^ XI dWi 



where 



XI = QtV* + V^Qt - tr {QtV* + V^Qt) ■ Qt and 
dWl = dWl-li{QtV* +V^<dt)dt. 



As usual, Wl, i = I,. . .,k, denote pairwise independent real- valued Wiener processes. In this situation our main 
theorem takes the following form. 



Theorem 4. We have almost surely 



1 '•* 



lim - / Qs{uj)ds ^ Qaoi^), 



where 0oo is a random variable, depending on the initial state "do 3,nd taking values in the equilibrium states. Again, 
the expectation of Goo is P'da- 

Proof. We follow the same line of argument as for jump processes. Here we only discuss the modifications needed 
for the diffusive case. We consider the stochastic processes (Mt)t>o and {Yt)t>i given by 

Mt 



Jo Jo ,^1 



and 

Ji s ^^^ Ji s 

As was shown in [Bel], [BGM], these are martingales. Again E''''(tr (F^-^)) remains bounded. Indeed dW^dW^ 
dWi dWi = dt by the Ito rules and W»{d{trY^)) = E''o(tr {dYtf) with 

^dYtf = 4 E E XlXldWldWl = 1 Y.{Xlfdt , 



i— 1 J — 1 i— 1 



SO that 



J 1 ^ ■ -, - T 

2—1 2—1 

The partial integration argument, which is also valid for diffusions, leads to Proposition 3. Step 1 and Step 2 in 
the proof of the main result remain unchanged. 

D 



VI. QUANTUM TRAJECTORIES IN DISCRETE TIME 

Our ergodic theorem also has a natural version in discrete time. Let us briefly sketch the setting. A time evolution 
in discrete time is given by the powers of a completely positive operator T with tr o T = tr . A Kraus decomposition 

fe 

i=l 

of T leads to an unraveling of this time evolution: Let f2 be the set of all infinite sequences (lui,lu2, ■ ■ ■) with ujj — 
1, . . . ,k. An initial state "do induces a probability measure P''" on il which is uniquely determined by the condition 

Then an unraveling of the time evolution (r")„>o is given by the Markov chain (0„)n>o on (f7,P''") with 



tr{V^^---V,,^oV*---V*J 



Theorem 5. As N ^ oo, the averaged process 

N-l 



N 

n=0 



converges ¥'^°-alinost surely to a random equilibrium state 0oo with expectation P{i3o). 

The proof is a discrete version of the argument in the previous sections, which corresponds to a variation on 
Breiman's indiviual ergodic theorem for Markov chains [Bre], [Kre]. 
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